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Abstract 



A class of valued constraint satisfaction problems (VCSPs) is characterised by a valued 
constraint language, a fixed set of cost functions on a finite domain. An instance of the problem 
is specified by a sum of cost functions from the language with the goal to minimise the sum. 

■ We study which classes of finite-valued languages can be solved exactly by the basic linear 
programming relaxation (BLP). Recently Thapper and Zivny showed |17j that if BLP solves 

■ the language then the language admits a binary commutative fractional polymorphism. We 
| prove that the converse is also true. This leads to a necessary and a sufficient condition which 

can be checked in polynomial time for a given language. In contrast, the previous necessary 
and sufficient condition due to |17| involved infinitely many inequalities. 



! 1 Introduction 

We consider a particular linear programming relaxation of a class of optimization problems called 
in this paper basic LP (BLP). This relaxation has been studied extensively in various domains, 
especially for objective functions with unary and binary terms. Researchers analyzed its proper- 
ties, developed efficient algorithms for (approximately) solving this LP, and applied to large-scale 
(N) ; practical problems [13 HH HH1 El HH1 HH [H [9] . 

It has been long recognized that for some classes of optimization problems (e.g. for submodular 
functions on a chain) BLP relaxation is guaranteed to be tight (i.e. the integrality gap is zero), and 
allows to solve the problem exactly. A natural question is whether it is possible to characterize 



5_i 1 such classes. 



One possible way to pose the problem formally is to use the framework of Valued Constraint 
Satisfaction Problems (VCSPs) [1]. In this framework a class of allowed objective functions is 
specified by a language T, which is a collection of cost functions over a fixed domain D. We say 
that BLP solves VCSP(T) if the relaxation is tight for all functions that can be expressed as a 
sum of functions from T with overlapping sets of variables. 

A major step in the characterization of languages that can be solved by BLP has been recently 
made by Thapper and Zivny |17] , They gave a sufficient condition for BLP to solve VCSP(T) 
that covers many known languages such as (1) submodular functions on arbitrary lattices; (2) 
/c-submodular functions; (3) weakly (and hence strongly) tree-submodular on arbitrary trees. 

Thapper and Zivny also presented a necessary and sufficient condition for BLP to solve 
VCSP(T). However, their characterization has one drawback: it involves infinitely many in- 
equalities, which leaves an open question whether checking the condition is a decidable problem 
for a given finite language T. 

We resolve this question affirmatively for finite- valued languages T. As our main contribu- 
tion, we show that BLP solves such T iff T admits a fractional symmetric polymorphism of arity 
k for some k > 2. We prove this result using a mixture of algebraic tools and techniques from 
Linear Programming. 



1 



Related work Kun et al. [12] studied the BLP relaxation for CSP problems and for robust 
approximatility of Max-CSPs. They showed, in particular, that BLP robustly decides a CSP 
language iff it has width 1. Width-1 CSPs were introduced in [7]. A simple characterization of 
such CSPs was given in [6]. 

Our work heavily exploits the notion of fractional polymorphisms [2] . Fractional polymorphisms 
is a generalization of multimorphisms [4]. It is known that they can characterize all tractable 
VCSPs [2]. 

We also mention the work of Raghavendra on analyzing SDP relaxations [14]. In particular, 
results in Chapters 6 and 7 of [H] imply that the basic SDP relaxation solves languages that admit 
a cyclic fractional polymorphism. This includes languages that satisfy our condition. 

2 Background and statement of the results 

Let D be a finite domain. A finite-valued language V is a set of cost functions / : D n Q where 
arity n > 1 may be different for different functions / G T. The argument of / is called a labeling. 

Definition 1. An instance I of the valued constraint satisfaction problem (VCSP) is a function 
D v — > Q given by 

Cost T (x) = ^ ft{x v (t,l) x v(t,n t )) 
iGT 

It is specified by a finite set of nodes V , finite set of terms T , cost functions ft : D nt — > Q of arity 
nt and indices v(t, k) £ V for t G T, k = 1, . . . , nt- A solution to X is a labeling x G D v with the 
minimum cost. Instance I is called a Y -instance if all terms ft belong to T. 

The class of optimization problems consisting of all T-instances is referred to as VCSP(T). 
Language T is called tractable if VCSP(T') can be solved in polynomial time for each finite 
T' C T. It is called NP-hard if VCSP{V) is NP-hard for some finite V C T. 

One way to tackle a VCSP instance is to formulate and solve a convex relaxation of the problem. 
Two examples are basic LP relaxation and basic SDP relaxation, as they are called in [17] and |14] 
respectively. 

The basic LP relaxation will be of particular relevance to this paper. Following [T7], we say 
that basic LP solves VCSP(T) if for any instance I from VCSP(T) the optimal value of the 
relaxation equals min x Costx{x). 

We will study which languages T are solved by basic LP. We will do it indirectly by relying on 
the characterization of [17] . The formulation of basic LP will not be used, and so we omit it in 
order to avoid unnecessary notation. We refer interested readers to [T7] for details. 

Fractional polymorphisms We denote O m to be the set of operations g : D m —> D. A 
fractional polymorphism of arity m is a probability distribution uj over O m , i.e. a vector with 
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permutation ir : [1, m] — > [1, m] and any (ai, . . . , a m ) £ Z) m . It is called cyclic if g(ai, a2 5 ■ • • 5 a m) = 
(a2> • • , fl m ,«i) for any (a±, . . . , a m ) G -D m . Note, in the case m = 2 both definitions coincide. A 
fractional polymorphism u) is called symmetric (cyclic) if all operations in supp(u) are symmetric 
(cyclic). As usual, supp(uj) denotes the support of distribution u: supp(uj) = {g G O m \ oj(g) > 0}. 

Generalized fractional polymorphisms Let Q m ^ k be the set of mappings g : D m — > D k . A 
mapping g G O m ~* k can also be viewed as a sequence of A; operations g = (51, ... , <7&) with ^ G O m . 
We define a generalized fractional polymorphism of arity m — > k as a probability distribution /9 
over m ^ fc . We say that language T admits p if every cost function / £ T of arity n satisfies 

E P(g)/ fc (g(^,---^ m ))</ m (^,---^ m ) V, 1 ,...,x™eD' 1 (2) 

Equivalently, p is a generalized fractional polymorphism of Y of arity m — > k iff vector 

w= P(g)-^(X 91 + --- + X 9fc ) (3) 

g=(9iv,9fc)G0™^ fc 

is a fractional polymorphism of T of arity m. 

We can identify fractional polymorphisms of arity m with generalized fractional polymorphisms 
of arity m — > 1. For brevity, we will omit the word "generalized". 

We always use the following convention: if g = (g\ , . . . , g^) is a mapping in 0' m_> ' fc then we extend 
it to m labelings x 1 , . . . ,x m 6 D n component- wise, i.e. [g(sc , . . . ,x m )] v = g(a;„, . . . ,a?™) for all 
v G [1, n]. Thus, g(x x , . . . , x m ) is a sequence of k labelings (g± (x , . . . , x m ), . . . gk(x , ■ ■ ■ , x m )) in 
D n . 

Fractional polymorphisms and SDP/LP relaxations It has been shown that fractional 
polymorphisms can be used for characterizing languages that can be solved exactly by certain 
convex relaxations. For the SDP relaxation, the following is known; it is implied by results in 
Chapters 6 and 7 of [13] . 

Theorem 2 ([14]). IfT has a cyclic fractional polymorphism of some arity k > 2 then the basic 
SDP relaxation solves VCSPfT ) in polynomial time. 

The more relevant for our paper case of the LP relaxation has been analyzed in [17] 

Theorem 3 ([H]). For a finite-valued language V, the basic LP relaxation solves VCSP(T) (in 
polynomial time) iffT admits an m-ary symmetric fractional polymorphism for every m>2. 

Theorem 4 ([17], Theorem 4.4). IfT admits a k-ary fractional polymorphism u such that supp(co) 
generates a symmetric m-ary operation then T admits an m-ary symmetric fractional polymor- 
phism. 

While the theorems give a necessary and sufficient condition for BLP to solve VCSP(T), it 
was not clear whether checking this condition for a given language T is a decidable problem (we 
would need to consider infinitely many values of m). 

Our result given below resolves this question affirmatively. 

Theorem 5. Suppose that a finite-valued language T admits a fractional polymorphism of arity 
k > 2 whose support contains at least one symmetric operation. Then T admits a symmetric 
fractional polymorphism of every arity m>2 (and thus basic LP solves VCSP(T)). 

The question whether the existence of a cyclic fractional polymorphism implies the existence 
of a symmetric fractional polymorphism remains open. 

1 Note, direction (i)=^(ii) of theorem [3] was proved only for a language F with finite |F|. With a straightforward 
continuity argument the theorem can be extended to languages with countable T (by showing first that the set of 
m-ary fractional polymorphisms of any T is a compact subset of R° ). 

2 Thapper and Zivny also present some results for infinite- valued languages; we refer to [IT] for details. 
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STP multimorphisms As a minor contribution, we formally prove that if a finite-valued lan- 
guage admits an STP multimorphism then it also admits a submodularity multimorphism with 
respect to some total order on D. (This has implications for the complexity classification of con- 
servative finite-valued languages.) This result is already known, but to our knowledge a formal 
proof has not been written down yet. We refer to section [J] for further discussion. 



3 Proof of theorem [5] 

We will prove the following result. 

Theorem 6. Suppose that a finite-valued language T over a domain D admits a symmetric frac- 
tional polymorphism of arity m — 1 > 2. Then F admits a symmetric fractional polymorphism of 
arity m. 

This will imply theorem Indeed, suppose that V admits a fractional polymorphism of arity 
k > 2 which contains a symmetric operation. Induction on m yields that T admits an m-ary 
symmetric fractional polymorphism for every m > k (we need to use theorem [J] for the base case 
and theorem [6] for the induction step). This also implies the claim for all m G [2, k — 1]: it is 
straightforward to show that if V admits a symmetric fractional polymorphism of arity pm where 
p, m G N then it also admits a symmetric fractional polymorphism of arity m. 

We thus concentrate on proving theorem [6j From now on we fix a symmetric fractional poly- 
morphism oj of r of arity m — 1. 

Consider a permutation tt of size m and a symmetric operation s G supp(uj) of arity m — 1. 
For such 7r and s we introduce the following definitions. 

• For a labeling a = (a±, . . . , a m ) G D m , let a w G D m and a s G D m be the following labelings: 

a 7 " = (Oir(l),--->07r(m)) ( 4 ) 
a s = (s(a_i),...,s(a_ m )) (5) 

where a_j G D m ~ l is the labeling obtained from a by removing the i-th element. 

• For an operation g : D m — > D, let g 77 : D m — > D be the following operation: 

g*(a)=g(a«) (6) 



For a mapping g : D m — > D m , let g s : D m — > D m be the following mapping: 

g » = [ g («)r (?) 



The last definition can also be expressed as 

g s = (sog„ 1 ,..., S og_ m ) (8) 

where g_« : D m — > j} m_1 is the sequence of m — 1 operations obtained from g = (gi, . . . , g m ) by 
removing the i-th operation. 

Let 1 be the identity mapping D m —> D m , and let T-L = {\ Sl --- Sk \ s\, . . . , s^ G supp(uj), k > 0} 
be the set of all mappings that can be generated from 1. 

Proposition 7. Every g = (g±, . . . ,g m ) G T-L satisfies the following: 

(9i,---,9m) = (9w(l)>---,9n(m)) V permutation tt (9) 
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Thus, permuting the arguments of gi(-, . . . , •) gives a mapping which is also present in the sequence 
g, possibly at a different position. 

Proof. Checking that 1 satisfies is straightforward. Let us prove that for any g : D m — > D m 
satisfying and for any symmetric operation s G mapping g s also satisfies Q. Consider 

i G [1, m]. We need to show that (s o g-i) n = s o g_ n ^y For each a G D m we have 

(sog-ifta) = sog^a 77 ) = sigiia 77 ), . . . , g^a 77 ), gi+^a 71 ), . . . ,5 m (a 7r )) 

= s{gj(a), . . .,gi-i(a),gf +1 (a), ... ,sl(a)) 

= s(sv(i)(a), . . . ,SV(i_i)(a),£v (m )(a), . . . ,s^( m )(a)) = sog_ l()) ( a ) 

□ 

Graph on mappings Let us define a directed weighted graph G = (T-L ,E,w) with the set of 
edges E = {(g, g s ) | g G % , s G supp(o;)} and positive weights w(g, h) = E sGs „p P ( w ),h=g s w ( s ) for 
(g, h) G E. Clearly, we have 

]T u/(g,h) = l gG^o (10) 

(g,h)e£ 

We define M[G] to be the set of strongly connected components H C 1i of G which are sinks, i.e. 
all edges in G from T~L lead to vertices in T~L. 

Proposition 8. For any % G M[G] and g G H there exists g G 7i with g o g = g. 
Proof. Note that l Sl --- s fc o h = h Sl --- Sfc for any s\, . . . , Sk G supp{uj) and h G O m ~~* m , since 

[l Sl "' Sfc o h](a) = l Sl "' Sfc (h(")) = [l(h(a))] Sl "' Sfc = [h(a)] Sl "' Sfc = h Sl '" Sfc («) Va G D m 

Therefore, conditions g G H , h G % imply that g o h G % (since g can be written as g = l si --- s fe 
and there are no edges leaving %). 

Since T~i is strongly connected, there is a path in G from gogG'HtogG'W, i.e. [gog] Sl - Sfc = g 
for some s±, . . . , s*. G supp(uj). Equivalently, h o g o g = g where h = l s i--- s *:. It can be checked 
that mapping g = hog has the desired properties. □ 

3.1 Proof overview: main theorems 

From now on we fix a function / G T of arity n. Recall that we defined f m (x , . . . , x m ) = 
h £ie[i,m] First ' we wil1 P rove 

Theorem 9. For each % G EI[G] there exists a probability distribution A over T~i (i.e. vector 
A G M> with ^gew = -U that satisfies the following for any labelings x 1 , . . . , x m G D n . 
Denote I = {(g, i) | g G H,i G [l,m]}, and for each (g, i) G / define labeling x sl G D n via 

(x^,...,x^)= S (x\...,x m ) (11) 

(a) For any k G [l,m] there holds 



iGfl.ml 



<0 wftere 4 = r . i/l_A: (12) 



^ if i £ [l,m] — {k} 

(b) If g', g" G % i/ien Z™^' 1 , . . . , x^' m ) = / m (x§" 1 , . . . , x^" m ] 
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Using this technical result, we will then establish 

Theorem 10. Consider a strongly connected component H £ M[G] and a mapping g £ %. Denote 
Range n (g) = {g(x 1 , . . . , x m ) | x l ,...,x m € D n }, and let p £ Qm^m ^ e an y ma pp{ n g suc }i that 
p(a) is a permutation of a for all a £ D m . 

For any (x 1 , . . . , x m ) £ Range n (g) there holds f m (x l , . . . , x m ) = f m (p(x 1 , . . . , x m )). 

Finally, we will prove the following. 

Theorem 11. Denote H = U^eMG] — There exists a fractional polymorphism p ofT of arity 
m —¥ m with supp(p) C H. 

Proving theorems [10] and [11] will be sufficient for establishing theorem [6] Indeed, we can 
construct an m-ary symmetric fractional polymorphism of T as follows. Take a symmetric mapping 
p £ O m ^ m satisfying the condition of theorem [TUl take vector p from theorem [TTl and define a 
fractional polymorphism of arity m — > m 

p' = £ P(g)*P°s 

g£supp(p) 

Language T admits p' since for any labelings x , . . . , x m £ D m there holds 

£ p'(h)r(h(x\...,x m )) = £ p(g)r( P (g(x i ,...,x m ))) 

h^supp(p') gSsupp(p) 

= £ P(g)/ ro (g(*\...,a: m )) < / m (x\...,x m ) 

g£supp(p) 

Note, for any h = (hi, . . . , /i m ) £ supp(p') operations hi,... , h m are symmetric. Indeed, we have 
h = pog for some g £ 7i . If a £ D m and ir is a permutation of size m then h(a 7r ) = p(g(a 7r )) = 
p([g(a)] 7r ) = p(g(a)) = h(a) which implies the claim. 

We can finally apply transformation ([3]) to vector p' to get a symmetric fractional polymorphism 
of arity m. 

3.2 Proof of theorem [9] 

First, we make the following observation. 

Proposition 12. Ifh = g s where g £ Ti, s £ supp(to) then x hj = s((x gl , . . . , x gm )_j) /or i € [1, m] 
where (x gl , . . . , x gm )_j is the sequence of m — 1 labelings obtained by removing the i-th labeling. 

Proof. Consider node v £ [1, n], and denote a = (xj, . . . , x™), j3 = (xf , . . . , xf m ), 7 = (x^ 1 , . . . , x^ m ) 
By definition (jlip . /3 = g(a) and 7 = h(a). Therefore, 7 = g s (ct) = [g(a)] s = /3 s . In other words, 
the i-th component of 7 equals s(/3_j), which is what we needed to show. □ 

For each (g, i) £ I we can write the polymorphism inequality for labelings (x gl , . . . , x gm )_j: 

£ u,( S )/( S ((x gl ,...,x gm )_ 4 )) < -J— £ /(x g ^) (13) 
L — ' m — 1 

s£supp(ui) jf£[l,m] — {i} 

Let us multiply this inequality by weight A g j > (to be defined later), and apply proposition 1121 
A g , £ o,( S )/(x h *) - £ /(x g ^) < V(g,z)£/ (14) 

sSsnpp(w),h=g s j'G[l,m]— {i} 
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Summing these inequalities over (g, i) £ I gives 



Y w ( s ) A hi - Y 



A 



so 



to — 1 



f(x si ) < o v(g,i)e/ (15) 



s£supp(uj),g=h a jE[l,m]— {i} 

The last inequality is equivalent to f 1 1 2 [> assuming that the following holds: 



Y w(h,g)X hi - y 



(h, g )es 



ie[i,m]-{i} 



TO — 1 



QA g V(g,i)e/ 



(16) 



where we denoted q = c\ for brevity. Next, we show that eq. (|16|) can be satisfied with the 
appropriate choice of weights {\ g i, A g }, thus proving theorem Eta). 



Lemma 13. There exists vector A G K>o^ i/iat satisfies (|16p and 

geW 



(17) 



Proof. Suppose the lemma does not hold. By Farkas lemma there exist vector y G M, 1 and scalar 
z G R such that 

z < (18a) 

z ~ Y ^ ( 18b ) 

ie[l,m] 

V ™(g,h)y hi - V -M- > V(g,i)G/ (18c) 

L — ' TO — 1 

(g,h)e£ je[i,m]-» 
Denote w g = Siefi ml 2/g«- Summing inequalities ()18cp over % G [1, m] gives 

^ w(g,h)n h -u g > VgG% (19) 
(g,h)e£ 

Denote = argmax{u g | g G From (jlOp and (|19p we conclude that g G implies h G 
for all (g, h) G E. Therefore, T~i* = Ti (since T~L is a strongly connected component of G). 

We showed that u g = C for all g G % where C £ M is some constant. We can assume 
w.l.o.g. that this constant is zero. Indeed, this can be achieved by subtracting C/m from values 
y s i for all (g, i) G / with g G H; it can be checked (using eq. (JTUJ) ) that this operation preserves 
inequalities (fT8l) . We thus have 

Y V S j = -Vsi V(g,i)el (20) 

ie[l,m]-{i} 



Substituting this into (|18c[) gives 

>( e. h^/u.- 4- 

to — 1 



Y w(g,h)y hi + ^- > V(g,i)G/ (21) 



(g,h)e£ 

Consider z' G [1,to]. Summing (|2ip over i G [1,to] — {i'} and then using (|20p yields 

£ w (g,h)(-y hi + ^- > V(g,i')6l (22) 

^-^ TO — 1 

(g,h)e-B 
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Combining (|2ip and (|22|) gives 

V w (g,h)y hi + ^- = V( gl t)e/ (23) 
L — ' m — 1 

Denote r g = £) ie n m] c «2/gi f° r g £ Summing ([23]) over z G [1, m] with appropriate coefficients 
gives 

V w(g,h)r h + -^- = VgG"H (24) 

771—1 

(g,h)e£ 

From (fTKajl and (fl~8bl) we conclude that r g < for all g G and thus eq. (f24l) cannot hold - a 
contradiction. 

□ 

We have proved part (a) of theorem [9) Next, we use a similar strategy to establish part (b). 
Namely, lemma [T4l below shows that we can choose weights {A g j} so that inequality (|15p becomes 
equivalent to 

E /(^) - E ^ s " 1 ) ^ ( 25 ) 

is[l,m] 

Using these inequalities for pairs (g',g") and (g",g') then yields theorem (9]^b). 



Lemma 14. There exists vector A G M> t/iai satisfi 



es 



V u;(h,g)A hi - V = c gi V(g,i)€/ (26) 

(h,g)eE je[l,m]-{i} 



where vector c£K J is defined via 



1 «/ g = g' 

-1 */g = g" (27) 
otherwise 



Proof. Suppose the lemma does not hold. By Farkas lemma there exist vector y G M, 1 such that 

E c g^g« < ( 28a ) 
(g,i)e/ 

E ^(g»^- E "^7 ^ v (g^) £/ ( 28b ) 

m — 1 

( g ,h)e£ je[i,m]-{i} 

Denote u g = X^iefi m] Using the same argument as in the proof of lemma [T3l we conclude that 
u s = C for all g G 7i where C G K is some constant. But then the expression on the LHS of (128aD 
equals C — C = - a contradiction. 

□ 

3.3 Proof of theorem HJH 

Let A G M>q be a vector constructed in theorem [9l Define 

^(x 1 ,...,*™) = EV/O^) where (^ gl ,...,x gm ) =g(x 1 ,...,x m ) (29) 
geH 



By theorem [9^a) we have 

E c- ■F i (x 1 ,...,x m ) < VJfee[l,m] (30) 

i£[l,m] 

Summing these inequalities over k G [l,m] gives on the LHS. Therefore, each inequality in (|30D 
is actually an equality. Subtracting these equalities for indices k and k' gives 

F k ,(x 1 ,...,x m ) = F k (x\...,x m ) Vk,kfe[l,m] (31) 

We denote F(x 1 , . . . , x m ) = F^x 1 , . . . , x m ) for i G [1, m]. 

Proposition 15. XTie following transformation does not change F(x 1 , . . . ,x m ): pick node v G 
[1, m] and permute values (x\, . . . , x™). 

Proof. It suffices to prove the claim for a permutation which swaps values x l v and x£ for i, j G [1, m] 
(since any other permutation can be obtained by repeatedly applying such swaps). Since m > 3 
there exists index k G [l,m] — Using proposition [71 it can be checked that the swap above 

does not affect labelings x gfc in (I29D for g G H, and therefore F k (x l , . . . , x m ) does not change. □ 

Now suppose that (x l , . . . , x m ) G Range n (g) where gGH. By proposition [8] there exists g G % 
with g o g = g. Clearly, we have g(x 1 , . . . , x m ) = (x , . . . , x m ), or equivalently (x s , . . . , x gm ) = 
(x 1 , . . . , x m ). Therefore, theorem [9jb) implies that / m (x gl , . . . , x gm ) = f m {x l , . . . , x m ) for all 
gGK. Using this fact and the definition of Fi(-), we can write 

f(x x , . . . , x m ) = - E = -£a b E /(* gi ) 

i£[l,m] gGW i6[l,m] 

= ^T\ s f m (xZ\..., X z m ) = = fV,...,x™) 

gew gGW 

To establish theorem 1 101 it remains to prove that condition (x , ...,x m ) G Range n (g) implies 
p(x x , . . . ,x m ) G Range n (g). This proof follows mechanically from proposition [7J and is omitted. 

3.4 Proof of theorem 1111 

We will rely on the following fact. 

Proposition 16. Suppose that p is a fractional polymorphism of T of arity m — ?■ m and g G 
supp(p) with A = p(g). Then vector 

p' = p- A-x g + A E W ( S )XV ( 32 ) 

s&supp(u)) 

is also a fractional polymorphism of V of arity m —¥ m. 

Proof. Denote the sum on the LHS of (|32p as p s , so that p' = p — A • Xg + A • p g . Consider function 
/ G r of arity n and labelings x , . . . , x m G D n , and denote (y , . . . , y m ) = g(x 1 , . . . , x m ). We can 
write 

E P g (h)/ m (h(xV..,x™)) = E w^/^g*^ 1 ,...^™)) 

h£supp(p g ) s^supp(uj) 

= E E /((tfV--.y m )-i) 



= - E E <"00/((»V--.y m )-i) 

i£[l,m] s£s"uj?j>(u/) 

^ ^ E / m -W,---,y m )-0) 



m 

iG[l,m] 



fV,...,2/ m ) = /"(g^ 1 ,...,^)) 
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Therefore, 

P '(h)r(h(x\... 7 x m )) = E p(h)/ m (Mz\ 

h.£supp(p') h.£supp(p) — {g} 

< £ p(h)/ m (h(z\ 

h£supp(p)-{g} 

hgsupp(p)} 

□ 

We can now prove theorem [TTJ Let be the set of fractional polymorphisms p of T of arity 
m — >• m with supp(p) C % . Let us pick p G £1 with the maximum value of p(%) = SgeH^s)' 
(Clearly, f2 is a compact set, so the maximum is attained by some vector in f2). We claim that 
supp(p) G Indeed, suppose that there exists g G supp(p) with g ^ By the definition of % 
there exists a path in G from g to a vertex h € %, i.e. h = g Sl --- s fc for some s\, . . . , G supp(uj). 
Therefore, we can repeatedly modify p by applying a sequence of transformations (|32[) to the 
current vector p and some g.; G supp(p) — H to get vector p' with larger weight p'(H), using at 
most k steps. This contradicts to the choice of p. Theorem [TT] is proved. 

We mention that a similar argument can be used as an alternative to the "tree cutting" argu- 
ment in the proof of theorem 4.4 in [T7j (and vice versa). 

4 STP multimorphisms 

In this section we consider Symmetric Tournament Pairs (STP) multimorphisms [3]. 

Definition 17. (a) A pair of operations (n,U) with n, U : D x D — > D is called an STP multi- 
morphism if 

afl a = a\J a = a VaG-D (idempotency) (33a) 

a n 6 = 6 n a, a\Jb = b\J a Va, b G D ( commutativity) (33b) 

{a n 6, a U b} = {a, 6} Va,6G-D (conservativity) (33c) 

^ Pair (n, U) is called a submodularity multimorphism i/ i/iere exists a total order on D for 

which a n b = min{a, b}, a U b = max{a, b} for all a,b G D. 

(c) Language T admits (n, U) if every function f G T of arity n satisfies 

f(xny) + f(xUy)<f(x) + f(y) Vx, y G D n (34) 

It has been shown in [3] that if V admits an STP multimorphism then VCSP(T) can be solved 
in polynomial time. STP multimorphisms also appeared in the dichotomy result of |10| : 

Theorem 18. Suppose a finite-valued language T is conservative, i.e. it contains all possible unary 
cost functions u : D — > {0, 1}. Then T either admits an STP multimorphism or it is NP-hard. 

To goal of this section is to prove the following. 

Theorem 19. If a finite-valued language T admits an STP multimorphism then it also admits a 
submodularity multimorphism. 

This fact is already known; in particular, footnote 2 in [10] mentions that this result is implicitly 
contained in [3], and sketches a proof strategy. However, to our knowledge a formal proof has never 
appeared in the literature. We now fill this gap. Our proof is different from the one suggested 
in [10], and inspired some of the proof techniques used in the main part of this paper. 



■ •■^ m )) + A 5j Ps (h)r(h(x\...,x m )) 

hSsupp(pg) 

...,x m )) + p(g)r(s(x\...,x m )) 
...,x m )) < r{ x \...,x m ) 
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4.1 Proof of theorem 

Consider a directed graph G = (D, E). We say that G is complete if for each pair of distinct labels 
a,b G D exactly one of the edges (a, b), (b, a) belong to E. We define a one-to-one correspondence 
between STP multimorphisms (n,l_l) and complete graphs G = (D,E) as follows: 

(a,b)eE (a n b, a U b) = (a, b) Va,beD,a^b 

It can be seen that (n, U) is a submodularity multimorphism iff the corresponding graph G is 
acyclic. 

Lemma 20. Suppose a finite-valued language T admits an STP multimorphism (n, U) correspond- 
ing to a directed graph G = (D,E), and suppose that G has a 3-cycle: (a,b), (b,c), (c, a) G E. Let 
G be the graph obtained from G by reversing the orientation of edge (a,b), and let (n,U) be the 
corresponding STP multimorphism. Then T admits (n,U). 



Proof. Let (A, V) be the following multimorphism: 

(x Ay,x Vy) ■- 



(x,y) if (x,y) G {(a, b), (b,a)} 

(xny,x\Jy) if (x,y) £ {(a, 6), (6, a)} 



First, we will prove that V admits (A, V) (step 1), and then prove that T admits (n,U) (step 2). 
We fix below function / G T of arity n and labelings x, y G D n . 
Step 1 Let us define labelings x',y' G D n via 

, / /x f{x v ,x v r\y v ) if (x v ,y v ) ^ (b, a) 
[x v ,y v ) = < vv € [1, nj 

[(c,c) if (x„,2A,) = (6, a) 

It can be checked that the following identities hold: 

x n y = y x U y = x (35a) 

x fly' = x Ay x Uy = x\/ y (35b) 

Let us write multimorphism inequalities for pairs (x',y) and (x,y'): 

f(x' Hy) + f(x' U y) < f(x') + f(y) (36a) 
f(xny') + f(xUy') < f(x) + f(y') (36b) 

Summing (|36ap and (|36bj) . cancelling terms using (|35ap . and then substituting expressions us- 
ing (|35bp gives 

f(xAy) + f(xVy) < f(x) + f(y) (37) 
Step 2 Let us define labelings x',y' G D n via 

, / / \ / (x v A y v , y v ) if (x v ,y v ) ^ (a,b) 
{Xv,Vv) = ] (c c) iff* y)-(ab) 

It can be checked that the following identities hold: 

x'Vy =y' x Ay' = x' (38a) 

x\J y' = x(Ay x' Ay = xf\y (38b) 
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Let us write multimorphism inequalities for pairs (x',y) and (x,y'): 



f(x> A y) + f(x' V y) < f(x')+f(y) 



(39a) 
(39b) 



f(xAy') + f(xVy') < f(x) + f(y') 



Summing (|39ap and (|39bp . cancelling terms using (|38ap . and then substituting expressions us- 
ing (|38bp gives 



□ 

We call the operation of reversing the orientation of edge (a, b) € E in a graph G = (D, E) a 
valid flip if [a, b) belongs to a 3-cycle. To prove theorem 1191 it thus suffices to show the following: 

• For any complete graph G there exists a sequence of valid flips that makes it acyclic. 

Such sequence can be constructed as follows: (1) start with a subset BCD with \B\ = 2; (2) 
perform valid flips in G[B] to make it acyclic, where G[B] = (B,E[B]) is the subgraph of G 
induced by B; (3) add a node c € D — B to B (if it exists) and repeat step 2. The lemma below 
shows how to implement step 2. 

Lemma 21. Suppose that G = (D, E) is a complete graph, D = BU {c} with c ^ B and subgraph 
G[B] is acyclic. Then there exists a sequence of valid flips that makes G acyclic. 

Proof. Suppose that G has a cycle C, then it must pass through c (since G[B] is acyclic): C = 
>b— >c— >a— Since there is a path from a to b in G[B] , we must have (a, b) S E (again, 
due to acyclicity of G[B]). Thus, c— >a— >b— >c is a 3-cycle in G. 

Let us repeat the following procedure while possible: pick such cycle and flip edge (c, a) to 
(a, c). This operation decreases the number of edges in G coming out of c. Therefore, it must 
terminate after a finite number of steps and yield an acyclic graph G. □ 

Acknowledgements 

I thank Andrei Krokhin for helpful discussions and for communicating the result of Raghaven- 
dra [H] about cyclic fractional polymorphisms. 

References 

[1] A. Blake, P. Kohli, and C. Rother, editors. Advances in Markov Random Fields for Vision 
and Image Processing. MIT Press, 2011. 

[2] D. Cohen, M. Cooper, and P. Jeavons. An algebraic characterisation of complexity for valued 
constraints. In In: Proceedings CP06. Volume 4^04 of Lecture Notes in Computer Science., 
Spring er-Verlag, pages 107-121, 2006. 

[3] D. Cohen, M. Cooper, and P. Jeavons. Generalising submodularity and Horn clauses: 
Tractable optimization problems defined by tournament pair multimorphisms. Theoretical 
Computer Science, 401(1):36-51, 2008. 

[4] D. Cohen, M. Cooper, P. Jeavons, and A. Krokhin. The complexity of soft constraint satis- 
faction. Artificial Intelligence, 170(11):983-1016, 2006. 



f(xny) + f(xUy) < f(x) + f(y) 



(40) 



12 



[5] M. C. Cooper, S. de Givry, M. Sanchez, T. Schiex, M. Zytnicki, and T. Werner. Soft arc 
consistency revisited. Artif. Intell, 174(7-8) :449-478, May 2010. 

[6] V. Dalmau and J. Pearson. Closure functions and width 1 problems. In In CP 1999, pages 
159-173. Springer- Verlag, 1999. 

[7] T. Feder and M. Vardi. The computational structure of monotone monadic SNP a and con- 
straint satisfaction: A study through Datalog and group theory. SIAM Journal on Computing, 
28(1):57-104, 1998. 

[8] V. Kolmogorov. Convergent tree-reweighted messages passing. PAMI, 28(10) :1568-1583, 
2006. 

[9] V. Kolmogorov and T. Schoenemann. Generalized sequential tree-reweighted message passing. 
CoRR, abs/1205.6352, 2012. 

[10] V. Kolmogorov and S. Zivny. The complexity of conservative valued CSPs. In SODA, 2012. 

[11] A. Koster, C. P. M. van Hoesel, and A. W. J. Kolen. The partial constraint satisfaction 
problem: Facets and lifting theorems. Operation Research Letters, 23(3-5) :89-97, 1998. 

[12] Gabor Kun, Ryan O'Donnell, Suguru Tamaki, Yuichi Yoshida, and Yuan Zhou. Linear pro- 
gramming, width-1 CSPs, and robust satisfaction. In Proceedings of the 3rd Innovations in 
Theoretical Computer Science Conference, ITCS '12, pages 484-495, New York, NY, USA, 
2012. ACM. 

[13] O. Meshi and A. Globerson. An alternating direction method for dual map lp relaxation. In 
European Conference on Machine Learning, 2011. 

[14] Prasad Raghavendra. Approximating NP-hard Problems: Efficient Algorithms and their 
Limits. PhD Thesis, 2009. 

[15] M. I. Schlesinger. Syntactic analysis of two-dimensional visual signals in noisy conditions. 
Kibernetika, 4:113-130, 1976. In Russian. 

[16] David Sontag, Amir Globerson, and Tommi Jaakkola. Introduction to dual decomposition for 
inference. In Suvrit Sra, Sebastian Nowozin, and Stephen J. Wright, editors, Optimization 
for Machine Learning. MIT Press, 2011. 

[17] J. Thapper and S. Zivny. The power of linear programming for valued CSPs. In FOCS, 2012. 

[18] M. J. Wainwright, T. S. Jaakkola, and A. S. Willsky. MAP estimation via agreement on 
(hyper)trees: Message-passing and linear-programming approaches. IEEE Transactions on 
Information Theory, 51(11):3697-3717, November 2005. 

[19] T. Werner. A linear programming approach to max-sum problem: A review. PAMI, 
29(7):1165-1179, 2007. 



13 



